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birthday 

In this paper, a general tree algorithm processing a random flow 
of arrivals is analyzed. Capetanakis-Tsybakov-Mikhailov's protocol 
in the context of communication networks with random access is an 
example of such an algorithm. In computer science, this corresponds 
to a trie structure with a dynamic input. Mathematically, it is related 
to a stopped branching process with exogeneous arrivals (immigra- 
tion). Under quite general assumptions on the distribution of the 
number of arrivals and on the branching procedure, it is shown that 
there exists a positive constant Ac so that if the arrival rate is smaller 
than Ac, then the algorithm is stable under the flow of requests, that 
is, that the total size of an associated tree is integrable. At the same 
time, a gap in the earlier proofs of stability in the literature is fixed. 
When the arrivals are Poisson, an explicit characterization of Ac is 
given. Under the stability condition, the asymptotic behavior of the 
average size of a tree starting with a large number of individuals 
is analyzed. The results are obtained with the help of a probabilis- 
tic rewriting of the functional equations describing the dynamics of 
the system. The proofs use extensively this stochastic background 
throughout the paper. In this analysis, two basic limit theorems play 
a key role: the renewal theorem and the convergence to equilibrium 
of an auto-regressive process with a moving average. 

1. Introduction. This paper investigates probabilistic algorithms which 
decompose recursively a given set of elements (also referred to as items) 
into random subsets until all subsets have a cardinality less than some fixed 
number D. The dynamic aspect of the algorithms analyzed here is that new 
elements are added to the subsets created during each decomposition. 
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The general procedure is as follows: if the cardinality of the set is strictly 
less than D > 0, the process is stopped. Otherwise, the set is split into 
several subsets and each subset receives a random number of new elements. 
The algorithm is then recursively applied to each of these subsets. A tree 
is naturally associated with this algorithm: the root node having the initial 
items; the subsequent nodes containing the corresponding subsets, and so 
on. At the end of this process, one ends up with a tree whose leaves contain 
less than D items and all internal nodes contain more than D items. Such 
an algorithm can be seen as a state dependent branching process which 
dies out whenever a termination condition is satisfied. When there are no 
arrivals of new elements, the algorithm is called static. Static tree algorithms 
are of fundamental importance as a generic class. They are used in computer 
science where the corresponding data structure is called a trie, and in many 
other areas such as communication protocols and distributed systems. See 
Mohamed and Robert [14] for a general overview of static tree algorithms. 

The extension analyzed here, with the Introduction of new elements, con- 
sists of introducing immigration to the language of branching processes. This 
situation is quite natural in the context of communication protocols where 
new requests (immigration) arrive continuously at the communication node. 
On the use of these algorithms in the context of communication networks, 
see the surveys by Berger [2] and Massey [12]. On the mathematical side, as 
it will be seen, the analysis of these algorithms turns out to be more delicate. 

Tree algorithm with immigration 

- Termination gondition. 
U n< D — y Stop. 

- Tree Structure. 

li n> D, randomly divide n into ni, . . . , no, with ni + ■ • • + no = n. 

Apply 5(ni + Ai), S{n2 + A2),. . . ,S{nG + Ac) 
where [Ai) are i.i.d. random variables. 

For the static algorithm, when there are no new arrivals, provided that 
the decomposition mechanism is not degenerated, it is easily seen that the 
associate tree is almost surely finite, in fact, that the total number of its 
nodes is integrable. Mohamed and Robert [14] investigates this case. 

Finiteness of the associated tree and law of large numbers. When there 
is a set of new items arriving with every time unit, it may happen that the 
algorithm does not terminate with probability 1, that is, that the associated 
tree is infinite. In this case, the algorithm cannot cope with the flow of 
arriving requests. This nontrivial phenomenon is analyzed in this paper. 
Furthermore, in the case where the process terminates almost surely and that 
there are n items at the root, another problem is to describe the asymptotic 
behavior of the average size of the tree as n gets large. As we will see, this 
is a quite challenging question. 
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Tree recurrences. In this setting the main quantity of interest is the 
total number of nodes of the associated tree when the algorithm starts with 
n items. The superscript of R:^ refers to the common distribution of the 
i.i.d. sequence (Ai). In this case, one gets naturally the recursive relation 

(1) -^n = 1 + i^tni+Ai + R2,n2+A2 ^ -^G.nc+Ac ) l{n>D} ; 

where, for i > 1, {Rf^,n > 0) are independent random variables with the 
same distribution as {R^,n > 0). The total size of the tree is 1 plus the size 
of all of sub-trees of level 1 . 

A Markovian representation. This algorithm can also be represented by 
a Markov chain (L^) on the set S = U£>o^^ finite sequences on N; its 
transitions are described as follows: if (Lg) = (/q, h^h, ■ ■ •) 



(2) (^i) 



{h + Ai,l2,---,ln,---) if ^0 < D, /SSHIFT/, 

{ni+Ai,n2, . . . ,nG,h,l2,h, ■ ■ ■) if lo>D, /split/, 

if the integer Iq is decomposed into Iq = ni + n2 + ■ • • + uq by the splitting 
procedure (see the precise description below). 

Note that if (1) and (2) are representations of the dynamics of tree al- 
gorithm; they differ in the following way. Equation (2) gives the state of 
the system just after one time unit, that is, the number of individuals with 
counter i, i>0, including the Ai new items. Equation (1) is a branching rep- 
resentation for the size of the "final" tree with its G children. For 1 <i <G, 
Ai is the number of new arrivals at the beginning of the time unit when the 
value of the counter of the ith subgroup (with cardinality rij) is 0. 

For n > 1, if the initial state is (Lg = (n, 0, . . . , 0, . . .)), then it is not diffi- 
cult to check that equation (1) 

i?^":^*inf{t>l:(L, = (0,...,0,...))}. 

The variable R^ can also be viewed as the hitting time of the empty state by 
the Markov chain (Lf). The ergodicity of the Markov chain (L^) is, therefore, 
equivalent to the fact that the variable R^_^ is integrable. Because of the 
description by a sequence (a stack in the language of computer science) , the 
tree algorithm is, sometimes, also called stack algorithm. 

Provided that the variables (R^) are integrable, the Poisson transform 
(f>{x) of the sequence {E{R^)) is defined as 



(3) 0(x)1^^5]E«)^e 



n>0 



In the case where the arrivals have a Poisson distribution with parameter 
A, the ergodicity of (L„) implies that the Poisson transform of the sequence 
(E(i?5^)) is well defined at x = X. 
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Iteration of noncommutative functional operators. Mathematically, these 
tree algorithms are quite challenging. By using an iterating scheme, a fam- 
ily of simple functional operators {P^v € (0,1)) play a central role in the 
analysis; if / : M+ M+ is a continuous function, they are defined by 



The static algorithm corresponds to the case when A = 0. 

By taking the expected value of (1) and by iterating the functional ob- 
tained, it turns out that the Poisson transform can be expressed by the 
following equation: 



for a convenient function / depending on some unknown constants and where 
W is some probability distribution on (0, 1). 

Note that the operators {P^v G [0, 1]) commute only when A = 0. This 
complicates significantly the analysis of the asymptotic behavior of expres- 
sion (4) as X goes to infinity. In the static case, one has that 



which gives a multiplicative representation of expression (4) which is ana- 
lyzed by using Mellin transform methods in an analytical context (see Fla- 
jolet, Gourdon and Dumas [10]) or by using random walks methods with 
a probabilistic approach (see Mohamed and Robert [14]). When A > 0, and 
such a multiplicative formulation is not available, these methods have, there- 
fore, to be adapted. It turns out that such a generalization is not straight- 
forward. 

Example (The binary tree) . The splitting mechanism is binary, and the 
branching number G is deterministic and equal to 2, G = 2, and with deter- 
ministic weights, Vii = p and V12 = q = 1 — p with p € (0, 1). The variables 
(Ai) are assumed to be Poisson with parameter A. The upper index A in 
{Rn) is replaced by A in this case. Provided that the variables are integrable, 
and if = E(i?^), the integration of (1) gives the identities Og = = 1, 
and, for n>2, 



(5) «^ = 1 + E U f^*?"" E ir«"'7r^"'("'+fc + ^n-^+i)■ 



In this case it is not difficult to check that the corresponding Poisson trans- 
form (j) satisfies the equation 



p:{f){x) = -f{xv+x). 




x>0, 



PO o PO o . . . o PO = P' 



(6) 



</)(x) = (j)(px + A) + (/)((?x + A) + h{x) 
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where x — >■ h{x) is some fixed function with a specific form and unknown 
coefficients. This functional relation can be rewritten as 

(^{x)= [' P.^{<P){x)Widw)+h{x), 
Jo 

where W = pSp + q5q, where 6x is the Dirac measure at x E M. A (formal) 
iteration of this function gives representation (4) for (p. 

Literature. These problems have been analyzed in several ways in the 
past. Motivated by the design of stable communication protocols, Tsybakov 
and Mikhailov [15] and Capetanakis [6] did the early studies in this domain 
(and, at the same time, designed the algorithms in the context of distributed 
systems) (see also Tsybakov and Vvedenskaya [16]). 

At the end of the 1980s, Flajolet and his co-authors, in a series of in- 
teresting papers [8, 9, 13], have obtained rigorous asymptotics for solutions 
of the type of equations as seen in (5), in several cases. In the first of the 
papers [8] , recurrence (5) for the binary tree is investigated. It is shown that 
for A smaller than some threshold, there is a unique sequence (a^) of real 
numbers which is the solution of this recurrence. In this paper, a sophisti- 
cated asymptotic analysis of the sequence (a^) is presented. Basically, it is 
shown that the sequence (a^) grows linearly with respect to n and its rate 
is, in some cases, a function with small fluctuations. It is conducted in three 
steps: 

(1) by iteration of this equation, express the Poisson transform (p of (a^) 
under the form (4), 

(7) (P{x) = Y^ h{ai^oai^o...oai^{x)), 

n>0ie{l,2}" 

where <ti(x) =px + X and <T2(x) = qx + X; 

(2) obtain the asymptotics of the Poisson transform 4'{x) as x goes to in- 
finity; 

(3) prove that {(/){x)) and (a^) have the same behavior as x (resp. n) goes 
to infinity. 

The main part of the analysis is devoted to step (2) where, via several esti- 
mates of series and contour integrals with arguments from complex analysis, 
the authors can identify in the series (7) the main contributing terms when 
X goes to infinity. Given the complexity of this analysis for this example of 
the binary tree, an extension of these methods to a more general branching 
mechanism seems to be more than challenging. The case when W is the 
uniform distribution on Q points is discussed in Section IV of Mathys and 
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Flajolet [13]. Note that if W has some Lebesgue component, and a repre- 
sentation of (/) as a series similar to (7) is no longer available, one has to go 
back to the general representation (4). 

In addition to extending these results to a quite general branching scheme, 
the purpose of this paper is also to develop probabilistic methods to analyze 
additive functionals of various tree structures. This program has been initi- 
ated in Mohamed and Robert [14] in the context of static tree algorithms. 
We nevertheless believe that, because of the intricacies of its associated equa- 
tions, the tree algorithm with arrivals provides a real significant test for this 
approach. It turns out that the method proposed in this paper has some 
advantage in that it can handle more easily and in a more general setting 
the complexity of the underlying noncommutative iterating scheme of this 
algorithm. 

Recent works deal with some aspects of these fundamental algorithms, 
see Boxma, Denteneer and Resing [5], Janssen and de Jong [11] and Van 
Velthoven, Van Houdt and Blondia [17], for example. For surveys on the 
communication protocols in random access networks, see Berger [2], Massey 
[12] and Ephremides and Hajek [7]. 

Contributions of the paper. The main objective of the paper is to present 
a probabilistic approach to these problems that can tackle, with a limited 
technical complexity, quite general models of tree algorithms with immigra- 
tion. 

For the model considered in this paper, (6) of the Poisson transform be- 
comes 



for some probability distribution W on (0, 1) describing the branching mech- 
anism of the splitting algorithm and some function h. The example of the 
binary tree corresponds to the case where W is carried by two points p and 
q, as noted before. When the measure W is carried by Q points of (0,1), 
the equivalent expression for the series (7) involves the various products of 
Q functions {am, 1 < m < Q). 

A. Stability of tree algorithms. The stability property of the tree algo- 
rithm, that is, the fact that the tree is almost surely finite, is a crucial issue 
for communication networks. Assuming Poisson arrivals with parameter A, 
it amounts to the existence of some threshold Aq > such that if the arrival 
rate A is strictly less than Aq, then the associated Markov process describing 
the tree algorithm (see above) is ergodic. During the 1970s and 1980s the 
design of stable protocols and the mathematical proof of their stability has 
been a very active research domain. Recently, because of the emergence of 
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wireless and mobile networks, there is a renewed interest in these models. 
The first protocols, Aloha and Ethernet, turned out to be unstable when 
there is an infinite number of possible sources, that is, for these algorithms, 
the number of requests waiting for transmission goes to infinity in distribu- 
tion for any arrival rate (see Aldous [1]). The tree algorithm corresponding 
to the example of the binary tree with p = q = 1/2 is the first such pro- 
tocol in a really distributed system where the stability region is nonempty 
(see Massey [12] and Bertsekas and Gallager [4]). In later papers, the tree 
algorithm has been improved in order to have a larger stability region. 

A gap in the proof of previous stability results. The stability results ob- 
tained up to now are under the assumption of Poisson arrivals. The proofs 
known to us rely on the analysis of of the type as in equation as in (5) 
for the sequence (E(i?^)); it is shown that there exists some Aq > such 
that for A < Aq, there is a unique finite solution (a^) and from there it is 
concluded that the corresponding Markov chain is ergodic. The problem 
here is that this analysis shows only that, for A < Aq, there exists a unique 
sequence (a„) of finite real numbers satisfying relation (5). The sequence 
(/5n) = (Ij 1) +00, . . . , +00, . . .) also satisfies relation (5). At this point, with- 
out an additional argument, it cannot be concluded that, for A < Aq, (E(i2^)) 
is indeed (an), and not (/?«)• To make the identification with (a„), it has to 
be proved that the random variables R^, n S N, are indeed integrable, but 
this is precisely the final result. Strictly speaking, the previous results have 
only shown that the system is unstable whenever A > Aq- 

This gap is fixed in this paper. The key ingredient to relate recurrence in 
relation (5) and the sequence (R^) is a perturbation result of the static case, 
that is, when A = 0. It is also shown that, under general assumptions on the 
distribution of the inputs {Ai) and on the branching mechanism, the tree 
algorithm is stable for a sufficiently small arrival rate. As far as we know, this 
is the first stability result for tree algorithms with non-Poissonnian arrivals. 

B. Analysis of general tree recurrences. The second part of the paper 
investigates the asymptotic behavior of the sequence (E{R^)/n) where {R^) 
is a solution of the tree recurrence (1) under the condition that A is a Poisson 
random variable with a parameter A less than some constant. 

Some of the ingredients of the analysis of static algorithms (A = 0) of 
Mohamed and Robert [14] are used. The situation is nevertheless completely 
different when A > 0. As mentioned above, the noncommutativity of the 
operators is a major issue. An additional important difficulty is the fact 
that, contrary to the case A = 0, the function h of (8) is unknown, and D 
coefficients have to be determined. 

To study these recurrences, the approach of the paper consists of express- 
ing series (7) for the binary tree or (4) in the general the expected 
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value of some random variable depending on some auto-regressive process 
with moving average (Xn) defined by Xq = x and 

(9) Xn+l = WnXn + 1, n > 0, 

where iyVn) is an i.i.d. sequence whose common distribution is W. 

Key limit theorems are used to derive the asymptotic behavior of the 
sequence (E(i2^)) such as the renewal theorem and the convergence of {X^) 
to its stationary distribution. In the particular case of the binary tree, they 
avoid the use of estimations of Fayolle, Flajolet and Hofri [8] which are 
necessary to get the significant terms of the series (7) in the asymptotic 
expansion. Roughly speaking, with these two limit theorems, the probabilist 
"knows" what are the most likely trajectories of the compositions of o"i 
and <T2. This approach simplifies significantly the asymptotic analysis of the 
algorithm. Another key step is to identify the D unknown coefficients of 
function h; they are expressed as a functional of the auto-regressive process, 
of its invariant distribution in particular. 

Outline of the paper. The paper is organized as follows: Section 2 shows 
that, under a quite general assumption of arrivals, the stability region is not 
empty. In Section 3, by denoting i?^, the size of the tree when n > elements 
are at the root, and under the assumption of Poisson arrivals, a probabilistic 
representation of the Poisson transform of the sequence (E(i?^)) is estab- 
lished, and an auto-regressive process with a moving average is introduced. 
Section 4 establishes the main stability result (Theorem 9) for general tree 
algorithm Poisson arrivals. Section 5 investigates the delicate asymptotics of 
the sequence (E(/?^)/n), and Theorem 12 summarizes the results obtained. 

2. Existence of a nonempty stable region. In this section it is proved 
that, if the arrival rate is sufficiently small, then the tree obtained with the 
algorithm is almost surely finite; its size is in fact integrable. 

Formulation of the problem. The algorithm starts with a set of n items. 
If n < D, then it stops. Otherwise, this set is randomly split into G subsets 
where G is some random variable. Now, conditionally on the event {G = ^}, 
for 1 <i <l, each of the n items is sent into the ith subset with probability 
Vi^i where Vi = {Vi^f, 1 < i < £) is a random probability vector on {1, ...,£}. 
The quantity Vi/ is the weight on the ith. edge of the splitting structure. 
Additionally, a vector {Ai, . . . , Ai) of independent random variables with the 
same distribution as some random variable A is given, and Ai new items are 
added to the ith subset. If rii is the cardinality of the ith subset, then, condi- 
tionally on the event {G = i} and on the random variables Vi^i, V2/, ■ ■ ■ , Vi^i, 
the distribution of the vector (ni, . . . ,ni) is multinomial with parameter n 
and {Vi^i, V2^e, . . . , V^/)- If the ith subset, 1 < i < n, is such that ni + Ai< D, 
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the algorithm stops for this subset. Otherwise, it is apphed to the ith subset; 
a variable Gi, with the same distribution as G, is drawn and this ith subset 
is split into Gi subsets, and so on (see Figure 1). 

The Q-ary algorithm considered by Mathys and Flajolet [13] corresponds 
to the case where G is constant and equal to Q and the vector of weights 
(Vi,Q, I <i <Q) IS deterministic. 

As in Mohamed and Robert [14], for the static case, the key character- 
istic of this algorithm is a probability distribution W on [0, 1] defined with 
the branching distribution (the variable G), and the weights on each arc 
[the vector {Vi^g, ■ ■ ■ i ^g,g)]- As we will see, the asymptotic behavior of the 
algorithm can be described only in terms of the distribution W. 

Definition 1. The splitting measure is the probability distribution W 
on [0,1] defined by, for a nonnegative Borelian function /, 

» / G \ +00 e 

(10) / /(x)>V(dx)=EK]y,,G/(^,,G) =EElP(^ = W^.,^/(^.,^))- 

\i=l / i=2 i=l 

In the context of fragmentation processes, the measure is related to the 
dislocation measure (see Bertoin [3]). 

The following conditions will be assumed throughout the paper: 

Assumptions (H). 
(Hi) There exists some <5 <1 such that the relation W{[0,5]) = 1 holds; 

(H2) [' M^>v(dx) < +00. 

Jo X 

Condition (Hi) implies, in particular, the nondegeneracy of the splitting 
mechanism, 

sup sup Vi^£ <6<1. 
e>2 l<i<l 




Fig. 1. First level of the tree algorithm to decompose n> D, n = ni + • • ■ + no and with 
arrivals (Ai). 
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Definition 2. For n > and p>l, define by Rn'^, the number of nodes 
with level (generation) less than pth when n items are at the root node. The 
variable A has the same distribution as the common distribution of the i.i.d. 
sequence (Ai) of the arrivals. By convention, Rn'°° = Rn ^-'^d (i?n^) refers 
to the static case, that is, when A = 0. The variable Ga is defined as 

i=0 k=l 

where, for i > 0, (5^, A; > 0) is an i.i.d. Bernoulli sequence independent of 
(Ai) such that F{Bl = 1) = 6\ 

Note that if E{A) < +oo, the variable Ga is well defined and integrable. 
The following lemma establishes a useful relation for tree sizes; the symbol 
<st is, as usual, for the classical stochastic ordering. 

Lemma 1 (Stochastic inequality). For n G N, under Assumption (H), 
the relation 

(11) ^n'^ ^st + Yl ^D~1+GA,^^{GA..>0} 

i=l 

holds where {Rn'^) fresp. {GA,i)J is a sequence of random variables with the 
same distribution as {Rn'^) (resp. Ga)- The variables {Rn'^), (Rn^) and 
{GA,i) are independent. 

Proof. First note that, for n <m, one has clearly that iin'^ <st Rm^- 
A coupling is used to prove the stochastic ordering (11). The splitting algo- 
rithm is first played only for the initial n items. The total number of nodes 
up to level p for the associated tree is Rn^. The leaves of the tree have, 
at most, D items, and the internal nodes have more than D items. 

Now external arrivals are added to the internal nodes along with the 
splitting algorithm played on these new items with the branching structure 
associated with until they reach one of the leaves of T^. From there, 
for all the leaves which have more than D items, the dynamic algorithm is 
played starting from this node. The number of external items at the leaves 
has thus to be estimated. 

Because of Assumption (Hi), an item in a node containing more than D 
items is sent to a given child of this node with a probability of, at most, 5. 
Hence, a given leaf L = Ii of with depth i <p contains at most D — 1 
initial items and a fraction of the number of new items Aj^^^, < k < p, 
arrives successively at the internal nodes connecting this leaf to the root. 
Each of the external items arrive at some node and goes to some fixed node 
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below with a probability of, at most, 5, so that, in distribution, there are at 
most 

Bl + Bl + . . . + B\^^^_^ 

such items at this node. Similarly, for 2 < k < i — external items that arrive 
at a node of level k will reach some fixed node of level i with a probability 
of, at most, 6^~^. Consequently, the total number Nj^ of items at leaf L is, 
in distribution, at most, 

p-2 Ai,i 
i=l k=l 

If Nl is greater than D, the dynamic algorithm continues at that leaf, start- 
ing with Nl + Aq <st D — 1 + Ga items. Note that if this event happens, 
there must be new items at this leaf, and thus Ga > 0. Otherwise, there are 
only the initial items at L, and therefore the algorithm stops. 

By noting that the number of leaves of 7^ whose depth <p is less than 
Rn^, one thus gets the desired relation, 

Ri'^ <.t + E ^D^l+G,„1{G..,,>0}. 
fc=l 

Theorem 3 (Existence of a stable system). Under Assumptions (H) 
for the splitting algorithm, and if A^ is a family of integrahle integer valued 
random variables such that 

lim A^ = {) in distribution and limsupE(A'^ | > 0) < +cxd, 

then there exists some eo > and a finite constant Cyy such that for any 
e ^ ^0; Rn^ is integrable and 

(12) E{Rf )<nGlv, V?i > 0. 

In particular, for such an e, the Poisson transform of the sequence (E(i?J^^)) 
is defined and differentiable on R. 

Note that the conditions on the family {A^) are quite weak to assert the 
stability of the algorithm for e sufficiently small. 

Proof of Theorem 3. If Fa^ is a random variable with the same 
distribution as {Ga<:\Ga<: > 0), 

K(F.O = p^^;^K(G.a,,,.>o|) 

<^ - = E{A'\A'>0)- ^ 



¥{A^>0){l-6) ' ' '1-6' 
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the assumptions of the theorem imply that E(F4e) is bounded by some 
constant K as e goes to 0. 

By Theorem 3 of Mohamed and Robert [14], there exists a finite constant 
Cyy such that 

E(i?0) < nC%, yn > 0, 

and, in particular, 

E(i?Vi+F^J<P + ^)Cvv 
With the variable i?n being integrable, relation (11) gives the inequality 

(13) E{Rf^n < E{R'^n + m'nnnoA^ > miRn-i+F,. ) > ^ > o, 

and therefore the relation 

moil+Fj < m'6'-i+Fji^+nGA^ > o)e(<?,_,^^j) 

< (I) + K)C0,(1+P(Ga. >0)E(<Xf,J) 

holds. It is easy to check that the variables {Ga<^) converge to in distri- 
bution as £ goes to 0. Consequently, there exists some £o > such that if 
e < £o, then P(Ga- > 0)(L> + K)C^ < 1/2, so that 

E(<Xf^J<2(D + K)C0;, 

and by letting p go to infinity, one gets E(i?;^l^^^^J < 2{D + K)Cy^. By 
using again (13) and Theorem 3 of Mohamed and Robert [14], this last 
inequality gives the relation 

E(i?f 'f) < nC%{l + 2{D + K)C^), 

the theorem is proved. □ 

Theorem 3 shows that for e sufficiently small, the random variables {Rn") 
are integrable but also that the variable R^s is integrable, and, in particular, 
the Markov chain defined by the transitions (2) is ergodic. 

Corollary 4 (Stability region for tree algorithms with Poisson arrivals). 
When arrivals are Poisson with parameter A and the branching mechanism 
defined by W satisfies Assumptions (H), there exists Aw > such that: 

(1) ifX<Xyv, the random variables (Rn) are integrable; 

(2) if X> Xw then E(i?^) = +oo for alln>D. 
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Proof. If is a random variable with a Poisson distribution with 
parameter A, the family (A^) clearly satisfies the assumptions of the above 
theorem. Hence, there exists Aq > and a constant C such that E(i?^) < nC 
for all n > 0. 

The sum of the components of the Markov chain defined by the transitions 
(2) decreases at most of D — 1 during a time unit and new arrivals have mean 
A, therefore, if A > D — 1, then IE(i?,^) = +oo for all n> D. The quantity 

Aw = sup{A > : K{R^) < +00} 

is thus positive and finite. Moreover, it does not depend on n> D; indeed, 
if E{R^) < +00 and for m> D, if m< n, clearly E{R^) < E{R^). If m > n, 
from (1) one obtains that R^ > R^l^ni+Ai=m} so that R^ is integrable. 
Since the function A — )■ lE(ii^) is nondecreasing, one obtains that if A < Aw 
then, for all n > 0, the variable R^ is integrable. □ 

3. Poisson transform. From now on and for the rest of the paper, it is 
assumed that the arrivals are Poisson with parameter A and, as before, one 
writes R^ instead of R^. The sequence J\f = < ii < • • • < t„ < • • •, is 
assumed to be a Poisson process with intensity 1 and, for x > 0, A/'([0,rc]) 
denotes the number of t„'s in the interval [0,2;], 

M{[0,x]) = inf{n:t„+i > x}. 

The Poisson transform (pr of a sequence (r^) is given by 

n>0 

Provided that this function is well defined on M, formally, 

Ere" 
(r„+i - r„) — e"^ = 4>Ar{x), 
n\ 

n>0 

where Ar = (r„_|_i — r„,n > 0). In other words, the Poisson transform com- 
mutes with the differentiation; the derivative of the Poisson transform of (r„) 
is the Poisson transform of the (discrete) derivative of (r„). The following 
relation is easily checked by induction, for n > and x > 0, 

(14) nrn-,N{[0M)) = E i'i) ^r'\^)- 

The next proposition establishes an important functional equation for 
the Poisson transform. For convenience, the Poisson transform of (E(i2,^)) 
is denoted by cpx instead of (p^x . 
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Proposition 5 (Poisson transform). Provided that A is small enough, 
the Poisson transform 4>\{x) of the sequence {R^) satisfies the relation 

(15) (t^x{x)=¥.(^-^^(t)x{\ + Wix)^+l-(pc{x), 

where Wi is a random variable with distribution W, and C = {Cm) is the 
sequence defined by Cm = for m> D and, for <m< D, 



k=0 

Proof. From Theorem 3 and relation (12), one gets that there exists 
some Ao such that (px is defined on M when A < Aq- By using the sphtting 
property of Poisson processes and by including the boundary cases of (1), 
one gets the relation 

G 

- l{A^([0,x])<Z)} XI ^i,m^S,.i,G,xSi,G])+Z,^ 
1=1 

where: 

- for 1 <i <G, Si^G is the ith. partial sum of the weights 

Si,G = Vi,G + ^2,G + • • • + Vi,G, 

in particular Sg,g = 1; 

- the variables Rij, i >l, j > 0, are independent and Ri^n has the same 
distribution as i?„ for any re > 0; 

- {Zi) is an i.i.d. sequence of Poisson random variables with parameter A. 

For k>0, the homogeneity properties of Poisson processes give 

E (^{M{lo,x])=k} ^i,m^Si_,^G,xSi^G])+z)j 
/ G \ 



- E l{Ar([o,x])=fc} Yl ^mo,xV,,G])+z, 



i=l 



pA 

Tffi 1 ^mo,^wi])+z 

l{^([o,^])=fc} — 



^Ar{[o,Wi])+Zi 



Wi 



1 

k 

kT 



Mi[0,l])=k]^e--, 
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where Wi is a random variable whose distribution is W. By taking the 
expected value of (16), one gets the relation 



D-l , pA 



EM- 



fe=0 



consequently, 

</.a(x) = 1+E 



e4 



D-l / oA 



k=0 



Wi 



For k>0, from (14), 

e( 



1^1 



Af{[0,l]) = k,Wj 



c—n \ / 



£=0 

EE 

£=0 m=0 



VF/-i(l-VFi)'=-Vf^(A) 



m=0 

The proposition is proved. □ 

An auto-regressive process with moving average. At this point, it is nat- 
ural to introduce the following sequence of random variables. 

Definition 6. The process {X^) is defined by Xq = x, and 
(17) X^ = W^„X^_i + l, n>l, 

where {Wn) is an i.i.d. sequence with the same distribution as Wi. 

The sequence {Xj^) is an auto-regressive process with moving average. 
These processes have interesting theoretical properties and play an impor- 
tant role in many areas. In the following the upper index x may be omitted 
when X = 0. 
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The terms of the sequence (X^) can be expressed as, for n > 0, 

n n n 

i=l p=l i=p+l 

with, for 1 < A;, vTfc = Hi^i The distribution of the sequence (Wj) being 
exchangeable, that is, invariant under permutations, one has 

n-l 

(18) XJ^'X^^^Y.'^,. 

p=0 

The sequence (X*) converges almost surely to X^, and therefore (Xi^) con- 
verges in distribution to the random variable Xoo such that 

+0O 

Xoo=ViXoo + l or =*X^ = 5^7rp 

p=0 

the distribution of X^o is not explicitly known in general. With this notation, 
(15) can be rewritten as 

</>a(x) = E(^^</.A(AXf/^) j + 1 - <Ac7(2;). 

By differentiating with respect to x, one gets 

(19) cl,'^{x)=K{cl>'^{XX^^^)) - 0Ac(x). 

Equation (19) expresses (p'^ as the solution of the Poisson equation associated 
with the Markov chain (Xn^^) and the function (pAC- Note that, neverthe- 
less, the function (p^c is depending on cpx through its successive derivatives 
at A. By taking x = X^q in (19) and integrating, one gets 

(20) E(0Ac(AXoo)) = O. 
The iteration of (19) shows that, for n>l, 

n-l 

4>'x{x) = E(0';,(AX^/^)) - J^E(</)Ac(vrfcX + AX^)), 

fe=o 

and consequently, 

+ 00 

(21) (t>'xix) = Coo-YH^Ac{^kX + XXk)) 

k=0 
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with Coo defined as 'E.{(j)\{\Xoo))- For /c > 0, by using relation (20) and the 
exchangeabihty property, 



E 



— ((/)c(vrfcx + \Xk) - 0c(AXfc)) 



— (0c(vrfcX + \Xl) - c^ci^Xl) - T^kX(p^c{\Xl,)) 



and since - -^^1 < vrfc/(l — 5) and < 1/(1 — by assumption (Hi), 
\4>c{T^kX + XXl) - (t>c{XXl) - ^fcX(/>Ac(AX^)| 

< ^{'^kxf\\(pA2c\\oo + T^kx\(f>Aci>^X^) - <AAc(AXfc)| 
^ of X^ X \., , II 

The integration of (21), term by term, is therefore valid, and this finally 
gives the following representation. 

Proposition 7 (Representation of Poisson transform). Provided that A 
is small enough, the Poisson transform (t)\{x) of the sequence (R^) satisfies 
the relation 

(22) <j)x{x) = 1 + xCoo + E (y^—[(j)ciXXk) - (PciTTkX + XXk)]] , 

where C = (Cn) is the sequence defined in Proposition 5 and Coo = ^i<P'xiXXoo)) ; 

(1) (Wn) is a sequence of i.i.d. random variables whose distribution is W. 

(2) (Xn) is the auto-regressive process defined by X„ = WnXn~i + 1 for 
n>l with Xq = and Xoo is its limit in distribution. 

4. Stability condition. In order to get the condition to get the existence 
of a first moment for the sequence (i?^), one has to establish an appropri- 
ate representation of this sequence by inverting probabilistically its Pois- 
son transform and to get an expression for the unknown constants Cq, 
Ci,...,Cd-i and Coo- 

The notation of Proposition 7 are used. Let Tk be the cj-field generated 
by the random variables Wi , . . . , Wk , and TVi is another Poisson process with 
rate 1 independent of M and (Wn), then, for /c > 1, 

4>c{'n-kx + XXk) 

= HCjV{[0,x7Tk])+Mi{[0,XXk]) I ^k) 
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lE(C_^([o,^^^])+Ari([o,AXfe]) I J='k,^f{[0,x]) =m)—e 

m>0 

lE(C^([o,.,])+M([o,AX,]) I J'k,M{[0, 1]) = 



m>0 

With (22), one obtains the relation 
(l)xix) = l+xa 



oo 

r™ / 1 



m>0 fc>0 

- CUm{[0,7Tk])+Af{[0,XXk])] 

where, if Ui, . . . ,Un are n i.i.d. random variables uniformly distributed on 
[0,1], for < X < 1, Un{[0,x]) denotes the number of U^s in the interval 
[0,x]. These variables are ordered as C/^"^ < UJ^2) ^ ' ' ' ^ ^(n)' particular, 
for m>l, {h(n{[0,x]) > m} = {UJ^j,^-^ < x}. By identifying the coefficients of 
the above expression, one gets the following proposition. 

Proposition 8 (Representation of the average size of the tree). Under 
Assumptions (H) and for A sufficiently small, 

(23) ^ 

+ — [CA^([0,AXfc]) - C'w„([0,7rfc])+Ar{[0,AXfe])] ) , ^ > 0, 

fc>0 ^ 

where M is a Poisson process with rate 1 and: 

(1) C = (Cn) is the sequence defined in Proposition 5 and Coo = IE((/>^(AXoo)). 

(2) For uniformly distributed random variables {Ui, 1 <i <n) on [0, 1] and 
< X < 1, the quantity Un{[0,x]) denotes the number of Ui 's in the in- 
terval [0, x] . 



Determination of the constants. In order to get an explicit representation 
of the sequence (E(i?^)), the D unknown coefficients Cq, . . . ,C£)-i (recall 
that the other C^'s are null) and the constant Coo = ^{(j^'xi^^oo)) have to be 
determined. The method used by Fayolle, Flajolet and Hofri [8] to determine 
these coefficients in the binary case apparently cannot be extended to other 
tree structures. 
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(i) The boundary conditions E(i?^) = 1 for 1 < m < D — I translate into 
D — 1 linear equations involving these D + 1 unknown constants, 



D-l 



(24) 



J2Mi^eCe + M^j,Coo = 0, l<m<D-l, 



with, foi 1 < m < D - 1,0 < £ < D - I, 



k>0 ^ ^ 



and = m. 



(ii) Equation (20) gives the additional relation 



(25) 



nCo + MA iCi + • • • + M^n-iCo-i = 



with 



o<e<D-i, 



and ^ = 0. 



(iii) The final equation is obtained by plugging x = A in (22) so that, 
since Cq = E(G)</)(A) by Proposition 5, 



1 = AC. 



E(G) 



Co 



(26) 



m=0 \fc=0 



ml 



m! 
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The matrix M\. The square matrix M\ = (M^ 1 < w, < D+1, < ^ < 
D) is defined as follows: 

= ^H—\^{M{[0,\Xk])=i} - l{Z^„([0,7rfc])+Ar([0,AXfc])=£}] 



k>0 ^ 

m<D,iy^D, 



lev-l 



<£<£>-!, 



/+00 



KKD-l, 



n = 0, M^^i n = A. 



By gathering equations (24), (25) and (26) and denoting e/j+i = (0, 0, . . . , 0, 1) 
and by C = (Co, Ci, . . . , Cd-IiCoo), the vector of constants, one gets the lin- 
ear relation 

(27) M^-C = -eD+i. 

The following theorem is the main result concerning the ergodicity of the 
tree algorithm. 

Theorem 9 (Stability of tree algorithm with Poisson arrivals). Under 
Assumptions (H) for the splitting distribution W, if M\ is the matrix defined 
above and 

Ac = inf{A > : det Ma = 0}, 

then Ac > and for any A < A^ the size of the tree associated to the tree 
algorithm is integrable. 

Proof. With the same notation as before, for A = 0, then = for 
< A; < +00 and the Dth and {D + l)th rows of the matrix A4x are given 
by 

AfD = (-l,l,0,...,0) and M^+i = (-1/E(G), 0, . . . , 0, 0) 
by expanding, with respect to these rows, one gets 

Ml, ... M^Vi 1 

2 



det Mr 



1 







E(G) 



K2 



^£3 



MO ^jo ... MO D-1 
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Since, for 1 < m,i < D — 1 



M 



rO _ 



— l{W„([0,^fe])=f} 




) 



then, MO 



for £ > m, and hence 



det Alo 



1 



D-1,_D-1 / 0- 



E(G) 



Ml^---M\ 



Due to the exphcit expression of the matrix Af>,, the function A — )• det M;^ is 
clearly continuous so that Ac > 0. 

Corollary 4 shows the existence of some constant Ayy such that, for A < 
Aw, random variables {R^) are integrable and their expected values are given 
by (23) and the constant vector C in this expression satisfies (27). Hence, 
for A < A>v A Ac, there exists a unique C such that (23) holds for E(i?^) for 
n > 0. Since the function A — >• lE(-R^) is nondecreasing and because of the 
existence of a solution to (27) A < Ac, the expression given by (23) is finite 
for any A < Ac; thus one concludes necessarily, by Corollary 4, that Ac < Aw- 
The theorem is proved. □ 

Remarks. 

(1) It is very likely that A>v defined in Proposition 4 and Ac are equal, 
but we have not been able to prove it. For A = Ac, at least one of the 
determinants of the Cramer formula should be nonzero which would 
imply that at least one of the (Cfc)'s is infinite, and therefore that the 
random variables {R^) are not integrable. 

(2) The coefficients of the matrix M\ are expressed in terms of the distribu- 
tion of the auto-regressive process (X„). An explicit, usable representa- 
tion of this distribution is available mostly through Laplace transform 
functionals, the invariant distribution included. 

Although it is not easy to handle, the Introduction of the auto- 
regressive process is, in our opinion, the key ingredient in our analysis. 
It plays a major role in representation (23) of the sequence (E(i?^)). 
It should also be kept in mind that one relation used to determine the 
constants {Ck) is (20) which comes directly from the fact that {Xn) has 
an equilibrium distribution. In a purely analytic setting (i.e., without 
this probabilistic representation) , an analogous equation would probably 
require some spectral analysis in a functional space. 

Examples. 

(a) Static case. In this case A = 0, and the components of the vector 
C = (Ci,0 < i < -D — 1) are constant and equal to the average branching 
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degree E(G) = E(VFf ^). For n>D, 

ml) = 1 + j;e(-J-i^^. , 

fc>0 ^""^ ^ 

which is the expression estabhshed for the static sphtting algorithm in Mo- 
hamed and Robert [14]. 

(b) Binary tree algorithm. In the binary case, G = 2, D = 2 and the spht- 
ting measure is W = p5p + q6q . In this case the average cost of the algorithm 
is expressed as follows: 

+ (2<^, (A) + <A', (A)) jg/ AX,e-^^^ ^^ ^^^^ 

fc>0 ^ / 

The two coefficients Co and C\ satisfy 

Co = 2(/>a(A), Ci = 2(/>a(A) + <A'a(A). 
Equation (20) implies that 

[E(e-^^°°) - AE(Xooe-^^°°)](:7i = E(e-^^°°)(:7o, 
which gives the relation 

^E(e-^^-) - AE(Xooe- 

Note that in the case of the symmetric binary algorithm, the limit is 
constant and equal to 2. 

A identity similar to (28) has been established in Fayolle et al. [9]. By tak- 
ing advantage of the fact that if one plugs x = \/p and x = X/q successively 
into (15) [(6) in this case], one gets the relation 

<^';,(A) = 2(i^-l)<AA(A), 

where 



(28) ^a(A) = 2( - 1 )^a(A). 



K 



if 1/2, 



,1/(1 — 2A), otherwise. 

This trick turns out to be specific to binary trees and does not seem to 
have a generalization for other random trees. Interestingly, when 1/2, 
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the representation of the constant K by (28) gives the following relation for 
g(A), the Laplace transform of X^q at A, 

g'{X) _ (1 + A/p)e-VP - (1 + \/q)e~^'i 
which can be solved as 



(29) E(e"''^°°) 



l/(l-p)-l/p A 



which gives an explicit representation of the Laplace transform of the in- 
variant measure of the auto-regressive process in this case. 

5. Asymptotic analysis of the average size of the tree. In this section, 
the asymptotic behavior of the sequence (E(i?^)) is investigated for A < Ac 
where Ac is defined in Theorem 9. The goal is to establish an analogue of 
the law of large numbers for these expected values. As noted before, Fayolle, 
Flajolet and Hofri [8] (for the binary tree) is the only rigorous result we 
know in this domain. 

Equation (23) gives the representation, for n> D, 

(30) EiR'j = 1 + nCoo - ^ J^E -AQ+^([o,AX,])l{c/,'^^,,<.,} , 

1=0 k>0 ^ ^ 

where (ACj) is the sequence (Q+i — Q) and, for < i < — 1 and n > 1. 
Recall that [/^"^ is the ith smallest term of n independent uniform random 
variables on [0, 1]. 

In a first step, it is shown that the series associated to i = in (30) is 
vanishing for the asymptotic behavior of the sequence (E(i2^)/n). This is a 
crucial result since the arguments to derive a law of large numbers rely on 
an integrability property which is not satisfied for this series. 

Lemma 2. Under Assumptions (H), the relation 



1 



E 

fc>0 

holds. 



lim -> IE — AC^([o,AXfe])l{c/," <7rfc} =0 



Proof. Equation (19) gives the relation 

An =^ ^Ef -J-A(:7^^([o,AX,])l{C/("^j<^fe} ) 
A;>0 ^ ^ 
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k>0 ^ ^ ^ 

k>0 ^ ^ 

< sup (|)AR^{^)■Y.^^Mm[>^X,^X,+^])^0,U-<nk}], 

0<x-<A/(l-5) V^fe J 

by assumption (Hi). For A; > 0, by exchangeability of the sequence (Wj) and 
definition (18), one gets 

= E 



= <5E(G)P(TyiC/('j) <(^^'+^). 

By summing up these terms, this gives the following upper bound for A^-, 
for some constant C, 

An <CYJ(WxU[^) < S'"-') < CEi\-\ogysiWiUj\^)]). 

k>0 

Since this term is of the order of logn, the sequence (An/n) converges to 0. 
□ 

Before analyzing the asymptotic behavior of (E(ii,^)/n), Propositions 9 
and 11 from Mohamed and Robert [14] obtained in the static case are sum- 
marized in the following proposition. 



Proposition 10. Under Assumption (H), for i>l, if 



-'t,n 

k>0 



(1) If the random variable — logVl^i is nonarithmetic, then 
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(2) If the random variable — log Wi is arithmetic and ^ > is its span, then, 
as n goes to infinity, 

lim ^-fJ'^)=0, 
where Fi is the periodic function defined by 
(31) Fi{x) = ^, — T / exp -^<^x ^}]—r^ '^y^ 



E(|log(T^i)|)l-e-«7o "V I e 
and {x} = X — [xj . 

The next proposition "decouples" the process (Xn) and the counting pro- 
cess associated to the sequence (vTfc). 

Proposition 11. Under Assumption (H), for I <i < D — 1, 

^^'f^lY.H^Mu-+i^<n,}[^Q+Mi[oAx,])-H^Q+^^^^ =0. 

fc>0 ^ ^ 

Proof. By using definition (18) and the exchangeability property, one 
has, for p > 1, 

< -iiAciioc J;e(-p(aa([ax,*, ax;]) / o I ^fc)im. ^^<.,}) 

< ||AC||oo(l - exp(-A57(l - m^i^n. 

by assumption (Hi) where Ei^n is defined in Proposition 10. One can there- 
fore choose a p sufficiently large so that the above difference is arbitrarily 
small, uniformly in n > 1. 

One has thus to investigate the asymptotic behavior of 

AQ+^([o,AXp]) 5Z ^l{c^("+i)<^fc} ) = ^E(^C'i+^([o,AXp])G'p(n)) 
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with 




When — logWi is nonarithmetic, Proposition 10 shows that E(Gp(n)) con- 
verges. With the same argument as in Mohamed and Robert, the condition- 
ing being on the first p elements of the sequence (Wk), almost surely, Gp{n) 
converges to the same limit as the sequence (E(Gp(n))). Consequently, by 
denoting x"*", the nonnegative part of x S M, 

E(|E(Gp(?i)) - Gp(n)l) = 2E([E(Gp(n)) - Gp(n)]+), 

and since the quantity [E(Gp(n)) — Gp{n)\^ is bounded by sup„E((S'p(n)), 
Lebesgue's theorem gives that the sequence (E(Gp(n)) — Gp{n)) converges 
to in Li. Therefore, the quantity 

|E(AQ+^([o,AX,])[G'p(n) -E[Gp(n)]])| < ||AC|UE(|Gp(n) - E(Gp(n))|) 

converges to as n goes to infinity. The proposition is therefore proved 
in this case. When — log Wi is arithmetic with range ^N, the argument is 
similar by using the fact that the convergence to of (Gp(n) — Fj(logn/^)) 
holds almost surely and for the expected value. □ 

The main result of this section can now be stated. It is a direct conse- 
quence of representation (30), Lemma 2, Proposition 10 and Proposition 11. 



Theorem 12. // A < Ac defined in Theorem 9 and under Assumption 

(H) , 

(I) if the random variable — logWi is nonarithmetic, then 

n-j-+oo n K[\[ogWi\) I 

(2) // the random variable — log Wi is arithmetic and is its span, then 

{Fi, I <i < D — 1) being the periodic functions defined by (31) 
where: 

- for i>l, ACi = Gj+i — Ci with C_= (Go, Gi, . . . , G^-i, Goo) being the 
vector solution of the equation 

Mx-C = -eD+i 

with Gfc = for k> D and Mx is the matrix above equation (27). 
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— N is a Poisson point process with rate 1. 

- The variable X^o has the invariant distribution of the auto-regressive pro- 
cess (Xn) defined by Xn+i = WnXn + 1, n > 0. 
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